Modern Subsampling Methods for Large-Scale Least Squares Regression
نویسندگان
چکیده
منابع مشابه
New Subsampling Algorithms for Fast Least Squares Regression
We address the problem of fast estimation of ordinary least squares (OLS) from large amounts of data (n p). We propose three methods which solve the big data problem by subsampling the covariance matrix using either a single or two stage estimation. All three run in the order of size of input i.e. O(np) and our best method, Uluru, gives an error bound of O( √ p/n) which is independent of the am...
متن کاملMethods for Large Scale Total Least Squares Problems
For solving the total least squares problems, min E;f k(E; f)k F subject to (A+E)x = b+f, where A is large and sparse or structured Bjj orck suggested a method based on Rayleigh quotient iteration. This method reduces the problem to the solution of a sequence of symmetric, positive deenite linear systems of the form (A T A ? 2 I)z = g, where is an approximation to the smallest singular value of...
متن کاملRobust Methods for Partial Least Squares Regression
Partial Least Squares Regression (PLSR) is a linear regression technique developed to deal with high-dimensional regressors and one or several response variables. In this paper we introduce robustified versions of the SIMPLS algorithm being the leading PLSR algorithm because of its speed and efficiency. Because SIMPLS is based on the empirical cross-covariance matrix between the response variab...
متن کاملTotal Least Squares Approach in Regression Methods
Total least squares (TLS) is a data modelling technique which can be used for many types of statistical analysis, e.g. a regression. In the regression setup, both dependent and independent variables are considered to be measured with errors. Thereby, the TLS approach in statistics is sometimes called an errors-invariables (EIV) modelling and, moreover, this type of regression is usually known a...
متن کاملEnsemble Methods and Partial Least Squares Regression
Recently, there has been an increased attention in the literature on the use of ensemble methods in multivariate regression and classification. These methods have been shown to have interesting properties both for regression and classification. In particular, they can improve the accuracy of unstable predictors. Ensemble methods have so far, been little studied in situations that are common for...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Cyber-Physical Systems
سال: 2020
ISSN: 2577-4867,2577-4875
DOI: 10.4018/ijcps.2020070101